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Abstract In this paper, we investigate Nash equilibrium payoffs for nonzero-sum stochastic differential 
games with reflection. We obtain an existence theorem and a characterization theorem of Nash equilibrium 
payoffs for nonzero-sum stochastic differential games with nonlinear cost functionals defined by doubly 
controlled reflected backward stochastic differential equations. 
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1 Introduction 

In this paper we study Nash equilibrium payoffs for nonzero-sum stochastic differential games whose cost 
functionals are defined by doubly controlled reflected backward stochastic differential equations (RBSDEs, 
for short). Fleming and Souganidis [1] were the first in a rigorous way to study zero-sum stochastic 
differential games. Since the pioneering work of Fleming and Souganidis [1], stochastic differential games 
have been investigated by many authors. Recently, Buckdahn and Li [2] generalized the results of Fleming 
and Souganidis [1] by using a Girsanov transformation argument and a backward stochastic differential 
equation (BSDE, for short) approach. The reader interested in this topic can be referred to Buckdahn, 
Cardaliaguet and Quincampoix [3], Buckdahn and Li [2], Fleming and Souganidis [1] and the references 
therein. 

El Karoui, Kapoudjian, Pardoux, Peng and Quenez [4] introduced RBSDEs. By virtue of RBSDEs 
they gave a probabilistic representation for the solution of an obstacle problem for a nonlinear parabolic 
partial differential equation. This kind of RBSDEs also has many applications in finance, stochastic 
differential games and stochastic optimal control problem. In [5] , El Karoui, Pardoux and Quenez showed 
that the price of an American option corresponds to the solution of a RBSDE. Buckdahn and Li [13] 
considered zero-sum stochastic differential games with reflection. Wu and Yu [6] studied one kind of 
stochastic recursive optimal control problem with the obstacle constraint for the cost functional defined 
by a RBSDE. 

Buckdahn, Cardaliaguet and Rainer [7] studied Nash equilibrium payoffs for stochastic differential 
games. Recently, Lin [8, 9] studied Nash equilibrium payoffs for stochastic differential games whose cost 
functionals are defined by doubly controlled BSDEs. Lin[8, 9] generalize the earlier result by Buckdahn, 
Cardaliaguet and Rainer [7]. In [8, 9], the admissible control processes can depend on events occurring 
before the beginning of the stochastic differential game, thus, the cost functionals are not necessarily 
deterministic. Moreover, the cost functionals are defined with the help of BSDEs, and thus they are non- 
linear. The objective of this paper is to investigate Nash equilibrium payoffs for nonzero-sum stochastic 
differential games with reflection. However, different from the earlier results by Buckdahn, Cardaliaguet 
and Rainer [7] and Lin [8, 9], we shall study Nash equilibrium payoffs for stochastic differential games 
with general running cost functionals, which are defined with the help of RBSDEs. In comparison with 
Buckdahn and Li [13] we shall study nonzero-sum stochastic differential games of the type of "strat- 
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egy against strategy", while Buckdahn and Li [13] considered the games of the type "strategy against 
control". The related works see [10], [11] and [12]. 

The paper is organized as follows. In Section 2, we introduce some notations and present some 
preliminary results concerning reflected backward stochastic differential equations, which we will need in 
what follows. In Section 3, we introduce nonzero-sum stochastic differential games with reflection and 
obtain the associated dynamic programming principle. In Section 4 we give a probabilistic interpretation 
of systems of Isaacs equations with obstacle. In Section 5, we obtain the main results of this paper, 
i.e., an existence theorem and a characterization theorem of Nash equilibrium payoffs for nonzero-sum 
stochastic differential games with reflection. 



2 Preliminaries 

Let B = {B t , < t < T} be a d— dimensional standard Brownian motion defined on a probability space 
(CI, J 7 , P). The filtration F = {Ft, < t < T} is generated by B and augmented by all P— null sets, i.e., 

F t = cr|s r ,0 < r < t\ VW P , 

where Afp is the set of all P— null sets. Let us introduce some spaces: 

• L 2 (Q, 7" T ,P;IR ra ) = \ £ | £ : CI ->■ M n is an Jr-measurable random variable 



such that E[|£| 2 ] < H 
S 2 (0, T; K) = ((p | ip : Cl x [0, T] -> K is a predictable process such that 

E[ sup |^| 2 ] < +oo \, 

0<t<T J 

H 2 (0,T;R d ) = jy? | ip : Vl x [0,T] R d is a predictable process such that 

E / \(p t \ 2 dt < +oo 
Jo 



We consider the following one barrier reflected BSDE with data (/, £, S): 
Y t = e + f(s,Y 3 ,Z s )ds + K T -K t - J Z. 



Y t 


= e + 


' Y t 


> s t , 


K 


= o, 



T 

dW s , 



te[0,T\, (2.1) 

T 

(Y t - S t )dK t = 0, 

where {K t } is an adapted, continuous and increasing process, / : SI x [0, T] x R x M. d — > K and we make 
the following assumptions: 

(#2.1) /(-,0,0) GH 2 (0,T;M), 

(H2.2) There exists some constant L > such that for all y, y' S M and z, z' S M d , 

y, z) - /(t, y', z')\ <L(\y- y'\ - \z - z'\), 
(H2.3) {S t }te[o.T] is a continuous process such that {S t }o<t<T £ S ,2 (0,T;K). 

The following the existence and uniqueness theorem for solutions of equation (2.1) was established in 

[4]- 

Lemma 2.1. Under the assumptions (H2.1)-(H2.3), if £ £ L 2 (Cl, ^r,P;M) and St < then equation 
(2.1) has a unique solution (Y,Z,K). 
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We refer to [4] and [6] for the following two estimates. 



Lemma 2.2. Let assumptions (H2.1)-(H2.3) hold and let (Y, Z,K) be the solution of the reflected BSDE 
(2.1) with data (£,g,S). Then there exists a positive constant C such that 

E[ sup Y s 2 + [ \Z S \ 2 + \K T - K t \ 2 T t ] < CE\e + ( [ g{s, 0, 0)ds) 2 + sup S 2 T t }. 

t<s<T Jt Jt t<s<T 

Lemma 2.3. We suppose that (£,,g,S) and (£', g', <S") satisfy assumptions (H2.1)-(H2.3) . Let (Y,Z,K) 
and (Y' , Z' , K') be the solutions of the reflected BSDEs (2.1) with data (t;,g,S) and (£',<;', S"), respec- 
tively. We let 

= Ag = g-g f , AS = S — S', 



AY = Y — Y', AZ = Z-Z', 
Then there exists a constant C such that 

l-T 



sup |AF S | 2 + / |AZ s | 2 ffs+|A/i T -AX t 

■<s<T Jt 



AK = K - K'. 



Tt 



CE 



|A£| 2 



\Ag(s,Y s ,Z s )\ds 















)' 




+ C \E 


sup \AS S \ 2 


Tt 


) 








t<s<T 







1/2 



1/2 
t,T i 



where 



t,T 



E 



/ \g{s,0,0)\ds ) + sup \S S 

K Jt J t<s<T 



l\2 



\g'(s,0,0)\ds 



sup IS* 

t<s<T 
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We also need the following lemma. For its proof, the interested reader can refer to [4] and [14] for 
more details. 

Lemma 2.4. Let us denote by (Y 1 , Z 1 , K 1 ) and (Y 2 , Z 2 , K 2 ) the solutions of BSDEs with data (/\ £\ S 1 ) 
and (f 2 ,£ 2 ,S 2 ), respectively. If^,^ G L 2 (f2, T T , P; R), S 1 and S 2 satisfy (H2.3), and f 1 and f 2 satisfy 
the assumptions (H2.1) and (H2.2), and the following holds 

we <e, p-a. s , 

(ii) f\t, y 2 , z 2 ) < f 2 (t, y 2 , z 2 ), dtd¥ - a.e 
(lii) S 1 < S 2 , P-a.s. 
Then, we have Y^ < Y 2 , a.s., for all t £ [0, T]. Moreover, if 

(iv) fit, y, z) < f 2 (t, y, z), (t, y, z) e [0, T] x R x R d , dtdF - a.e 

(v) S 1 = S 2 ,F-a.s. 

Then, K\ < K 2 , P — a.s., for all t G [0, T], and {K — K 2 } t£ \Q x] is a decreasing process. 



3 Nonzero-sum stochastic differential games with reflection and 
associated dynamic programming principle 

In what follows, we assume that U and V are two compact metric spaces. The space U is considered as 
the control state space of the first player, and V as that of the second one. We denote the associated 
sets of admissible controls by U and V, respectively. The set U is formed by all U- valued E-progressively 
measurable processes, and V is the set of all V- valued F-progressively measurable processes. 
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For given admissible controls u(-) G U and v(-) G V, let us consider the following control system: for 

te[o,T], 



X 



t,x;u,v 



b( S ,X t s ^ v ,u s ,v s )ds + <j{s,X t s ^ u ' v ,u s ,v s )dB s , sG [t,T], 
x G W\ 



(3.1) 



where 



b : [0, T] x R™ x U x V -> R", cr : [0, T] x R™ x U x V -» R" xd . 
We make the following assumptions: 

(H3.1) For all x G R n , &(-,x, •, •) and cr(-,x, ■, •) are continuous in (t, u, v). 
(H'i.2) There exists a positive constant L such that, for all t G [0,T],x,x' G R ra , u G U, v G V, 
\b(t, x, u, v) — b(t, x , u,v)\ + \cr(t, x, u, v) — a(t, x', u,v)\ < L\x — x'\. 

Under the above assumptions, for any u(-) G U and v(-) G V, the control system (3.1) has a unique strong 
solution {Xl' x ' u ' v , < t < s < T}, and we also have the following standard estimates for solutions. 

Lemma 3.1. For all p > 2, there exists a positive constant C p such that, for all t G [0, T], x,x' G R n , 
u(-) G U and v(-) G V, 



sup \Xl> x > u > v \ v 

t<s<T 



sup \xl' x ' u ' v -X^^f 

t<s<T 



<C p (l + \x\ p ), F-a.s., 
Ft 



^ Cp \ x x | ^ , 



where the constant C p only depends on p, the Lipschitz constant and the linear growth of b and a. 

For given admissible controls u(-) G U and v(-) G V, let us consider the following doubly controlled 
reflected BSDE: 



j Y t,x;u,v = / f j (r,Xl' x ' u ' v , iYt' XiU ' v , j Z^ x ' u ' v ,Ur,V r )dr 



3R, 



t,x;u,v j jj-t 
T 



j K t,x;u,v _ j J /J- ' " ' d I', ^ . S e[t,T] 
J s 



(3.2) 



j K t, X ;u,v = Qj / ( . ;y -r., : „... / /; ; r . A-;- ,: "'' })r/ " I). 



where X t,x ' ,u,v is introduced in equation (3.1) and 

$j = <5>j(x) : R" K, hj = hj(t, x) : [0, T] x R" -> R, 
/j = /,•(*, x, y, z, u, v) : [0, T] x R™ x R x R d x C7 x V -> R. 

We make the following assumptions: 

(i?3.3) There exists a positive constant L such that, for all t G [0,T],x,x' G R™, y,y' G R, z, z' G R d , 
u E U and u G V, 

\fj(t,x,y,z,u,v) - fj(t,x',y',z',u,v)\ + \$j(x) - ®j(x')\ + \hj(t,x) ~ hj{t,x')\ 
<L{\x-x'\ + \y-y'\ + \z-z'\). 

(H3A) For all (x, y,z) G R™ x R x R d , fj(-, x, y, z, •, •) is continuous in (t, u, v), and there exists a positive 
constant L such that, for all t, s G [0, T], x G R™, 



|ftj(£, x) — hj(s, x)| < £|£ — s 
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Under the assumption (H3.3), from [4] we know that equation (3.2) admits a unique solution. 

For given control processes u(-) £ U and v(-) £ V, let us introduce now the associated cost functional 
for player j, j = 1,2, 

Jj(t,x;u,v) := j Y^\ s=t , (t,x) £ [0,T] x R n . 

From Buckdahn and Li [13] we have the following estimates for solutions. 

Proposition 3.2. Under the assumption (HS.l)-(HS.S), there exists a positive constant C such that, for 
all t £ [0, T], u(-) £ U and v{-) £ V, x, 

pY t *' x;u '"| < C(l + P-a.s., 

yyt,x;u,v _ jyt,x';u,v\ < _ p _ a g 

We now recall the definition of admissible controls and NAD strategies, which were introduced in [8]. 

Definition 3.3. The spaceUt^r (resp., Vt,r) of admissible controls for 1 th player (resp., 2 th ) on the in- 
terval [t,T] is defined as the space of all processes {urjve[t,T] (resp., {Vr}rs[t,T\)> which are ¥ -progressively 
measurable and take values in U (resp., V). 

Definition 3.4. A nonanticipating strategy with delay (NAD strategy) for 1 th player is a measurable 
mapping a : Vt,T — > Mt,T> which satisfies the following properties: 

1) a is a nonanticipative strategy, i.e., for every ¥ -stopping time r : Q — > [t, T], and for Vi,V2 £ Vt,T 
with Vi = i>2 on [[t, t]], it holds a(v\) = 01(1)2) on [[t, r]]. (Recall that [[t, r]] = {(s, w) £ [t, T] x f2, t < s < 

2) a is a strategy with delay, i.e., for all v £ Vt.T, there exists an increasing sequence of stopping 
times {S n (v)} n >i with 

i) t = S (v)~< &(«)<...< S n (v) <••• <T, 
«) U n >A S n(v) = T} = n, V-a.s., 
such that, for all n > 1 and v,v' £ Vt.r,^ £ J~t, it holds: if v = v' on [[t, S n —i(v)]] f](T x [t,T]) ; then 
Hi) Si(v) = Si(v'), onT, 1 < I < n, 
w) a(v) = a{v'), on [[t,S n (v)]]f\(T x [t,T]). 

We denote the set of all NAD strategies for 1 th player for games over the time interval [t,T] by At,T- 
The set of all NAD strategies (3 : Lit,T Vt,T for 2 th player for games over the time interval [t, T] is 
defined in a symmetrical way and we denote it by Bt,r- 

NAD strategy allows us to put stochastic differential games under normal form. The following lemma 
was established in [8]. 

Lemma 3.5. If (a, f3) £ At,T x Bt,T? then there exists a unique couple of admissible control (u,v) £ 
Ut.T x Vt.T such that 

a(v) = u, /3(u) = v. 

If (a,/3) £ At,T x £>t.T, then from Lemma 3.5 we have a unique couple (u,v) £ Ut.T x Vt.T such that 
(a(v), )3(u)) = (u,v). Then let us put Jj(t,x; a, j3) = Jj(t,x;u,v). Therefore, let us define the lower and 
the upper value functions Wj and Uj, resp., of the game: for all (t, x) £ [0, T] x K™, we put 

Wj(t, x) := esssup essinf Jj(t, x; a, /3), 

aeAt, T P^ B t,T 

and 

Uj(t,x) := essinf esssup Jj(t, x; a, (3). 

p£B t]T aeA t ,T 

Under assumptions (H3.1)-(H3.3) we see that Wj(t,x) and Uj(t,x) are random variables. But using 
the arguments in [3] and [9], we have the following proposition. 
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Proposition 3.6. Under assumptions (H3.1)-(H3.3), for all (t,x) G [0, T] x R™, the value functions 
Wj{t,x) and Uj(t,x) are deterministic functions. 

Let us now recall the definition of stochastic backward semigroups, which was first introduced by Peng 
[15] to study stochastic optimal control problem. For a given initial condition (t,x), a positive number 
5 < T — t, for admissible control processes u(-) 6 Ut,t+s and v(-) € Vt,t+s, and a real-valued random 
variable rj 6 £ 2 (^, P; K) such that 77 > /ij(t + 5, X t fg J,,v ), we define 



j f~<t,x;u,v 
U t,t+5 



j—t,x;u,v 



■ ~t X ' u u ■ i X "LL u ■ £ X ' u u 

where ( 3 Y ' , 3 Z ' , 3 K ' ) is the unique solution of the following reflected BSDE over the time 



interval [t, t + 5]: 



y * 



t+S 



+ I /,-(r,X<™, 3 Y t ; x;u ' v , 3 Z^ ,u rt v r )dr 



J K t+s - 3 K 8 



t+S 



3 z*; x ' ,u ' v dB r , se[t,t + 5], 



jy t,x;u,v > h ^ x t,xiu,vy s e[t,t + S\, 



-=-?t,X;U,V 



3 K 



0. 



t+S 



-=yt,x;u,v 



0. 



and X*' a:;tl ' ,; is the unique solution of equation (3.1). 

For (rj, a;) e [0, T] x E™, (u, u) e W i>T x V t ,r, < <5 < T - 5, j = 1, 2, wc have 

Remark 3.7. We consider a special case of fj. If fj is independent of(y,z), then we have 



t+s 



Jj(t, x; u, v) = J G$£;7fo] = E V + / /,-(r, u r , v r )dr + 3 K^ s 



Tt 



Proposition 3.8. Under the assumptions (H3.1)-(H3.3) we have the following dynamic programming 
principle: for all < <5 < T — t, x £ R n , 

W j (t,x) = esssup o essinf i & t ffi[W j {t + 5,X%i a >< > )], 



a€A t - 



and 



Uj (t,x)= essinf esssup 3 G^/ [Uj (t + 6, . 



The proof of the above proposition is similar to [3] and [9], we omit the proof here. 

Proposition 3.9. Under the assumptions (H3.1)-(H3.4), there exists a positive constant C such that, 
for all t, t' S [0, T] and x, x' S K™, we have 

(i) Wj(t,x) is ^-Holder continuous in t: 

\W j (t,x)-W j (t',x)\ < <7(l + |x|)|t-t'|*; 



(ii) \W j {t,x)-W j (t,x')\ < C\x-x'\. 

The same properties hold true for the function Uj . 

By means of the standard arguments and Proposition 3.8 wc can easily get the above proposition. 
The proof of the above proposition is omitted here. 
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4 Probabilistic interpretation of systems of Isaacs equations with 
obstacle 

The objective of this section is to give a probabilistic interpretation of systems of Isaacs equations with 
obstacle, and show that Wj and Uj introduced in Section 3, are the viscosity solutions of the following 
Isaacs equations with obstacle, for (t,x) G [0,T) x R™, 



tin {Wj(t, x) - hj(t, x), -^jWjfa x) - H~(t, x, Wj(t, x), DW 3 {t, x),D 2 Wj{t, x))} = 0, 

W j (T,x) = * j (x), 
and 

nan^Uj(t,x) - hj(t,x), -^Uj(t,x) - H+(t,x,U j {t,x),DU j (t,x),D 2 U j {t,x))} = 0, 
respectively, where 

Hj(t,x,y,p, A,u,v) = -tr(aa T (t,x,u, v)Aj) +pb(t,x,u, v) 

+fj(t, x, yj,p<r{t, x, u, v), u, v), 

(t,x,y,p,A,u,v) G [0,T] x R n x R x R d x § d x U x V, 



(4.1) 



(4.2) 



Hj (t,x,y,p,A) = sup inf Hj(t,x,y,p,A,u,v) 



and 



Hf{t,x, y,p,A) = inf ' sup Hj(t,x,y,p, A,u,v) 

We denote by Cf b ([0,T] x R n ) the set of real-valued functions which are continuously diffcrcntiablc 
up to the third order and whose derivatives of order from 1 to 3 are bounded. Let us recall the definition 
of a viscosity solution of (4.1). The definition of a viscosity solution of (4.2) can be defined in a similar 
way. The interested reader is referred to Crandall, Ishii and Lions [16] for more details. 

Definition 4.1. Let w G C([0,T] x R";R) be a function. It is called 

(i) a viscosity subsolution of (4-1) if 

Wj(T,x) < ®j(x), for all, x e 1", 

and if for all functions ip G C ; 3 b ([0,T] x M. n ),j = 1,2, and (t,x) G [0,T) x R™ such that Wj — ip attains a 
local maximum at (t,x), 

min jtUj-(t,a;) - hj(t,x), -^p 3 {t,x) - Hr(t,x,w j (t,x),D(p j (t,x),D 2 ip j (t,x))^ < 0, 

(ii) a viscosity supsolution of (4-1) if 

Wi(T,x) > $i(x), for all j = l,2,x€ R", 

and if for all functions ip G C ; 3 b ([0,T] x W l ),j = 1,2, and (t,x) G [0, T) x R" such that Wj — (p attains a 
local minimum at (t,x), 

min |w, (t, x) — hj(t, x), ~—uij(t, x) — HJ{t, x, Wj (t, x), Dtpj (t, x), D 2 (pj (t, ir))| > 0, 

(iii) a viscosity solution of (4-1) if it is both a viscosity subsolution and a supersolution of (4-1)- 
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Theorem 4.2. Under the assumptions (H3.1)-(H3.3), the junction Wj (resp., Uj) is a viscosity solution 
of the system (4-1) (resp., (4-2)). 

Proof. For arbitrarily fixed j = 1,2, we only prove that the function Wj is a viscosity solution of the 
system (4.1). Let us consider the following BSDE, for (t,x) G [0,T] x M", m G N, 

f T 

j,m Y t,x;u,v = $.(X% X -' U > V ) + / fj(r, X l r ' x ' u ' v , 3,m Y t,x;u,v j,m z t,x;u,v ^ ^ 

J s 

+ f T m{ 3 >y r i ' i;tt '° - hj(r, X*' x '' u ' v ))-dr - f ^ m Z\: x ^ v dB r , s G [t, T), 

J s J s 

and define 



s=t ' 



From Lemma 3.5 it follows that there exists a unique couple (u, v) G Ut.T*-Vt,T such that (ct{v), (3(u)) = 
(u,v) thanks to (a,/3) G .At,T x £>t,T- Hence, we can define Jj {m (t,x;a, f3) — Jj {m (t,x;u,v), and we put 

Wj im (t, := esssup cssinf Jj m (t, x; a, /3). 

Using a similar argument to that in [3] we see that Wj >m is of linear growth and is the unique viscosity 
solution of the following Isaacs equation: 

-4wW*,aO -H^ m (t,x,Wj, m (t,x),DWj, m (t,x),D 2 Wj, m (t,x)) = 0, 
"* (4-3) 

W s , m (T,x) = &j(x), 

where for (t, x, y,p, A, u, v) G [0, T) x M" x E x M d x § d x [/ x V, 

H~ m (t,x,y,p,A) = sup inf ^ (itr(crcr T (i, a;, u, +pb(t,x,u,v) 

+fj(t,x,y,pa(t,x,u,v),u,v) + m(y - h(*,x)) - }. 

Using an argument similar to that in Buckdahn and Li [13] we have the following lemma. 
Lemma 4.3. For every (t,x) G [0,T] x R™ and m > 1, the following holds: 

WW*, as) < W jtm +i{t,x) < Wj(t,x), 

and 

Wj(t,x) = lim Wj !m +i(t,x), 

is a viscosity supersolution of (4-1)- 

Let us admit for a moment the following lemma, and its proof will be given later. 
Lemma 4.4. For every (t,x) G [0,T] x 1™, Wj(t,x) is a viscosity subsolution of (4-1). 

From the above both lemmas and Theorem 4.7 it follows that Wj(t, x) = Wj(t, x). The desired result 
then follows. □ 

Let us come to the Proof of Lemma 4.4. 
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Proof. Let j = 1,2 be arbitrarily fixed, (t, x) G [0, T) x R", and 5 6 [0, T - 1]. For (p G C, 3 b ([0, T] x M"), 
we define 



Fj(s,x,y,z,u,v) 



d 1 

— (p(s, x) + —tr(aa (s, x, u, v)D 2 (p(s, x)) + Dip(s, x)b(s, x, u, v) 
+fj(s, x,y + ip(s, x),z + Dip(s, x).a(s, x, u, v), u, v), 



where (s, x, y, z, ii,u)e[0,T]xR"xRxM' i x{/ x V. 
We consider the following BSDE: 



( f t+s 

Y^' u ' v = J F J {r i X*' x ^' v i Y r 



t+s 



'dB r , 



Y}' u ' v > hj{s,X^ x ' u ' v ) - (p(s,X t s ' x '' u ' i ') 

t+8 



s g [t,t + 5], 

t,x:u,v\ \ jjyl.u.v 



0. 



K}' u - V = 0. 



(4.4) 



where X t ' x - U ' v is the solution of (3.1). 

Note that F(s, x, y, h, z, u, v) is Lipschitz in (y, h, z), uniformly in (s, x, u, v), and there exists a positive 
constant C such that 



^-(s,a;,0,0,0,w,u) < C(l + |a:| 2 ), (s,x,u,v) G [0,T] x R n x U x V. 

Therefore, equation (4.4) has a unique solution (Y 1 > U ' V ,Z 1 ' U ' V ,K 1 > V ' V ). Moreover, we have the following 
lemma. 

Lemma 4.5. For every s G [t,t + 5], we have 

Let us also consider the following reflected BSDE: 

»t+5 



Y~ 



F 3 (r, x, Y r 2 ^,Z^,u s ,v r )dr + K?# v - K 2 ' u - V 



t+s 



Z 2 ' uv dB r 



Y?>«> v >h j (a,Xt> x * l > v )-<p(8,X t a > ,e -<»> v ), se[t,t + 6], 

t+S 



Y r - h j( r , X r )-^{ r , X r )) dK 



0, 



R 2,u,v = Q _ 



(4.5) 



Then we have the following lemma which estimates the difference of Y^' u,v and Y 2,u ' v . 
Lemma 4.6. For u G Ut,t+6, v G Vt,t+Si there exists a positive constant C such that 

|jri,«,._yW|< Ci f ) F-a.s., 

where the constant C does not depend on 5, neither on the control processes u and v. 

Using the standard arguments for BSDEs and Lemma 2.3 we can obtain the above two lemmas. We 
omit the proof here. 

Let us prove that Wj is a viscosity subsolution of (4.1). For arbitrarily fixed j — 1, 2, we suppose that 
Wj < ip, Wj(t,x) — (p(t,x) and Wj(t, x) > h(t,x). Since Wj and h are continuous there exist 5q > and 
t > such that 



Wj(s,x') - hj(s,x') > t, for (s,x') G [0,T] x E™ such that \(t,x) - (s,x')\ < S . 
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and we can choose tp such that 

Wj(s,x') - <p(s,x') < -t, for (s,x') £ [0,T] x R™ such that \(t,x) - (s,x')\ > 6 . 
Consequently, 

hj(t, x) - <p(t, x) < -t, for (t, x) e [0, T] x K n . 
In what follows we shall prove that: 

inf sup Fj(t, x, 0, 0, 0, u, v) > 0. 

We suppose that this is not true. Then, due to the continuity of F, there exist some 6 > 0, v * £ V and 
< 5' < T - t such that 

sup Fj (s, x, 0, 0, 0, u, v*) < -6 < 0, (4.6) 

u£U 

for all s E [t,t + 6']. 

By virtue of the Lemmas 2.4 and 3.5 we see that 

On the other hand, from Proposition 3.8 it follows that 

csssup^ it+4 essinf^ 8t , t+5 3 G^f[W 3 {t + 5,X^)} ~ <p(t,x) = W^x) - ip(t,x) = 0. 
Consequently, 

csssup QS _ 4t t+5 essinf^ eBt ^ t+s Y^ a ' p > 0. 
Let us define (3*{u) = v* on [t,r d ] x U t T s. Then j3* € B t T s. By Lemma 4.6 we have 



o < 


esssup ae _ At 




< 


esssup ae _ At 


T s Y t 


< 


esssup QG ^ t 


T 1 




esssup ae _ At 


2Mv*)y +cs - 


< 


esssup„ eWt 





(4.7) 



where we have used that Y t 2 ' Q '' 3 = Y^' a ^ v , since /3*(a(v*)) = v*. Moreover, for all <5 > 0, e > 0, we 
have the existence u e € U t T s such that 

t > esssup„ ew ^ 5 Y t -£(5. 

From the above inequality and (4.7) it follows that 

Y t 2 ' uS - v ' >-CSi -eS. (4.8) 

Let us consider the following BSDEs: 

n 3 <^* = £ + F^xX^^^y^^v^dr+K^; ' v ' -K 3 s ' ue > v ' 

t+S 



(y r 3.«V +r )d r = , j^*"* 
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and 

ft+<5 ft+S 



Y s = / (C|F r | + C\Z r \ - 6)dr + K t+S - K s - / Z r dB r , 

J S J S 



Y s >-t, se[t,t + S], K t = (4.9) 
t+s 

(Y s + r)ds = 0. 



We choose 6 such that 6 < 8' and ^(1 — exp (— CS)) < r. Then the solution of (4.9) is 

F s = --(l-exp(C(s-t-<5)), Z s =0, K s = 0, se [t,t + S]. 
By Lemma 2.4 and (4.8) we see that 

Consequently, 



-(l-cxp(-CSj) > -C6* -e5, 



-^(l-exp(-CG)) > -e. 
Finally, letting (5—5-0 and e — S- we conclude 6 < 0. This is a contradiction with 8 > 0. Consequently, 

inf sup x, 0, 0, 0, u, w) > 0, 

v ^ v ueu 

from which we conclude that Wj is a viscosity solution of (4.1). □ 

Let us now give a comparison theorem for the viscosity solution of (4.1). We first introduce the 
following space: 

9 : = jy e C([0,T] x R") : there exists a constant A > such that 

lim |( / 3(i,2;)|cxp{-^[log((|a;| 2 + l)^)} 2 } = 0, uniformly in t E [0,T]|. 

| a: | — f oo J 

Theorem 4.7. Under the assumptions (HS.l)-(HS.S), if an upper semicontinuous function u\ E 6 is a 
viscosity subsolution of of (4-1) (resp., (4-2)), and a lower semicontinuous function U2 G O is a viscosity 
supersolution of of (4-1) (resp., (4-2)), then we have the following : 

ui(t,x) < u 2 (t,x), for all (t,x) £ [0,T] x M". 

By means of the arguments in Barlcs, Buckdahn and Pardoux [17], we can give the proof of this 
theorem and the proof is omitted here. 

Remark 4.8. By Proposition 3.9 we see that Wj (resp., Uj) is a viscosity solution of linear growth. 
Therefore, from the above theorem we know that Wj (resp., Uj) is the unique viscosity solution in O of 
the system (4-1) (resp., (4.2)). 

Isaacs condition: 

For all (t, x, y,p, A, ii,i))6[0,T]xl"xIxIxI li x§' l x[/ x V, j = 1, 2, we have 
sup inf i —tr{aa T {t, x, u, v)A) + pb(t, x, u, v) + fj(t, x, y,pa(t, x, u, v),u, v)\ 

„CTJ v&v 12 > 

f l ( 4 - 10 ) 
= inf sup < —tr{po~ T (t, x, u, v)A) + pb(t, x, u, v) + fj(t, x, y,pa(t, x, u, v),u,v) >. 



ueu 

Corollary 4.9. Let Isaacs condition (4-10) hold. Then we have, for all (t,x) E [0, T] x 

{U 1 (t,x),U 2 (t,x)) = (Wi(t, a), W a (*,*))• 
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5 Nash equilibrium payoff 



In this section we suppose that Isaacs condition (4.10) holds. In order to simplify arguments, let us also 
assume that the coefficients b,a, fj,$j, fj and hj satisfy assumptions (H3.1)-(H3.4) and arc bounded. 
By Isaacs condition (4.10) and Corollary 4.9 we see that, for (t, x) G [0, T] x R n , 

W\{t,x) = esssup cssinf Ji(t, x; a, /3) = essinf esssup Ji(t, x; a, /3), 

aeAt.T fieBt.T @EBt,T aeAt.T 

and 



W 2 (t,x) = essinf esssup J2{t, x; a, /3) = esssup essinf J 2 (t, x; a, /3). (5-1) 

aeAt.T peB t ,T peB t ,T a <^ A t.T 

Let us introduce the definition of the Nash equilibrium payoff of stochastic differential games (see Lin 
[8] or Buckdahn, Cardaliaguet and Rainer [7]). 

Definition 5.1. A couple (ei,e2) G K 2 is called a Nash equilibrium payoff at the point (t,x) if for any 
e > 0, there exists (a £ ,/3 £ ) € At,T x £>t,T such that, for all (a,/3) <E At t r x Bt,T, 

Ji(t,x;a e ,j3 e ) > Ji(t,x;a,j3 £ ) - e, J 2 (t, x; a £ , (3 e ) > J 2 (t, x; a £ , (3) - e, P-a.s., (5.2) 

and 

\nJ 3 {t^;a e ,p e )]-eA<e, j = 1,2. 

From Lemma 3.5 it follows that the following lemma holds. 

Lemma 5.2. For any e > and (a e ,/3 e ) G At,T x &t,T, (5.2) holds if and only if, for all (u,v) £ 
Ut,T x Vt,T, 

Ji(t, x;a e ,f3 e ) > Ji(t, x;u,p e (u)) - e, J 2 (t, x; a e , /3 E ) > J 2 {t, x; a e (v), v) - e, P-a.s. (5.3) 
Before giving the main results in this sections we first introduce the following lemma. 

Lemma 5.3. Let (t,x) G [0, T] x 1™ and u G Ut.r be arbitrarily fixed. Then, 

(i) for all S G [0,T — t] and e > 0, there exists an NAD strategy a G At,T such that, for all v G Vt,T, 



a(v) = u, on [t, t + S], 

2ytgr,a<v),v < ^ + ^ ^a(«),«j + ^ p _ a g 

(ii) for all 5 G [0, T — t] and e > 0, there exists an NAD strategy a G At.T such that, for all v G Vt t T, 

a(v) = u, on [t, t + 6], 

i Y t^a(v),v > Wi[t + S} xffiW") - e, P - a.s. 



Using arguments similar to Lin [8] we can prove this lemma. The proof is omitted here. We also need 
the following lemma, which can be established by standard arguments for SDEs. 

Lemma 5.4. There exists a positive constant C such that, for all (u, v), (u', v') G Ut,T x Vt,T, and for 
all T r -stopping times S : Q — > [t, T] with x<j x,u,v = ' v , P — a.s., it holds, for all real r G [t, T], 

E[ sup \X^ AT - Xl^ T f\f t ] < Cr, P - a.s. 

Let us now give one of main results in this section: the characterization theorem of Nash equilibrium 
payoffs for nonzero-sum stochastic differential games with reflection. 
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Theorem 5.5. Let Isaacs condition (4-10) hold. Then, for (t,x) G [0, T] x R™, (e 1; e 2 ) el 2 is a Nash 
equilibrium payoff at point (t, x) if and only if for all e > 0, there exist u £ <E Ut,T and if € Vt.r such that 
for all s € [t, T] and j = 1, 2, 

j Y t,x;u*,v° > WjfaXt'**''"') - e | J- t ) > 1 -e, P - a.s., (5.4) 
and 

\E[J j (t,x;u £ ,v £ )]-e j \<e. (5.5) 
Proof of Theorem 5.5: Sufficiency of (5.4) and (5.5). 

Proof. For arbitrarily fixed e > and some £o > (eo depends on e and will be precise later), let us 
assume that (u £ °,v £ °) £ U t ,T X Vt,T satisfies (5.4) and (5.5), i.e., for all s £ [t, T] and j = 1,2, 

p( Jy^ ^ > W 3 {s,Xl^ ue °^ )- e | Ji) > 1 - e , P - a-s-, (5.6) 

and 

|E[J 7 -(t,z;</<> £ °)] - ej -| <e - (5.7) 

We fix some partition: t = to < ti < ■ • ■ < f m = T of [t,T] and put r = sup — Let us apply 

i 

Lemma 5.3 to u £o and t + S = t±, ■ ■ ■ ,t m , successively. Then, for e\ > (ei depends on e and is specified 
later) we have the existence of NAD strategies cti S At,T, i = 1, - ■ ■ , m, such that, for all v € Vt,T, 

ai(v) = u £o ,on [t,ti], 
2 Y t,*-Mv),v < W 2 (t i ,X t t f' ai( - v) ' v )+e 1 ,¥-a. S . (5.8) 

For all v S Vt.r, we set 

S v = inf {s > t | A({r G [t, s] : u r ^ v £ °}) > o}, 
i™ = inf {ti > S v | i = 1, • • • , m| A T. 

Here A denotes the Lebesgue measure on the real line KL We see that S v and i" are stopping times such 
that S v < t v <S v +t. 
We put 

u £ °, on [[«,*"]], 

ai(«), on (ti, T] x |f u = 1 < i < m. 
Then, a e is an NAD strategy. It follows from (5.8) that 



a s (v) 



2 v t,x;a e (v),v _ 2\rt,x;a e: (v) ,v -, 

r t" - 2^ r *i i {t"=*i} 

i=l 
m 

i=l 

= W 2 (t v ,X t t f' a ^ v) ' v )+e 1 ,¥-a.s. (5.9) 
Let us show that, for all e > and v € Vt,T, 

J 2 (t,x;a s (v),v) < J 2 (t 1 x;u £0 ,v £0 ) +e, a £ {v £o ) = u £ °. (5.10) 
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Thanks to (5.9), from Lemmas 2.3 and 2.4 we see that there exists a positive constant C such that 



J 2 (t,x,a s (v),v) 



G 



<• 2Qt,x;a e (v),v 



[W 2 {t v ,X t t f^ {v) - v )]+Ce 1 . 



Therefore, from Lemma 2.3 

| 2 G t ^ {v) ' v [W 2 {t v ,X t t f-' uBO ' veo )] - 2 G^ {v) ' v [W 2 {t\Xlf' as{v) ' v )}\ 

< cmw^t^x^ ^ ) - w 2 {t v ,x t t f' aAv) > v )\ 2 r t ]i 



< CE[\X\„ 

< Ct?, F-a.s. 

for the last two inequalities we have used Proposition 3.9 and Lemma 5.4. Then, (5.11) yield 

J 2 (t,x,a £ (v),v) 

< 2 Gl^ iv) ' v [W 2 (t v ,X t t f' uS °' v ' )] + Ce l 

+ | 2 G^ t i a '' {v) - v [W 2 {t\Xll x ' u '°^ a )] - 2 G\* t f^ v) - v [W 2 {t\Xl?' a ^ v )]\ 

< 2 Gl^ aAvhv [W 2 (t v ,X t t l x -' ueo ' v '°)} + Cey + Cri. 



Putting 



we have 



a, 



{ X^ B °^° > W 2 {s,Xl^ B0 ^ )- e },s € [t,T]. 



J 2 (t,x;a s (v),v) 

m 

< 2 G^ (w) ' l '[^iy 2 fe,<: K;ueo ^°)l {t „ =ti} ] +Ce 1 + Ct? 



< 2 Gl: x t ^ {v) ' v [J2 W^Xlf^ ^)^^!^] + Cei + Cri + i. 

i=l 



where 



(5.11) 



(5.12) 



(5.13) 



)l{t"=t l }ln ti 



I=\ ^SfW^E^ttlf"^"'")!,,,,,] - 2 G^ {v) ' v \^2w 2 (t l: X^°' 

i=l i=l 

Since & 2 , f 2 and h 2 are bounded, from Lemma 2.2 we conclude that W 2 is bounded. Therefore, 



/ < E[^|iy 2 (t 4 ,<^°^°)| 2 l {t „ =ti} lo^^ 

m 

< Cj2n%\Ft)* <Cmel, 

i=l 

where we have used (5.6) for the latter estimate. From the Lemmas 2.3, 2.4 and (5.12) we have 

m 

2 ^;^ w ^[£^ 2 (^,x*f^ ^°)i {t ^ ii} in ti ] 

i=l 



(5.14) 



i=l 
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^ 2 r ,i,i;a e (»),ii [ V^ 2 v t,x:u e ° , 

- G «,t" i/^ y *i l{t»=t 4 }ln tj + £ oJ 



i=l 
m 

,D j- V^ 2 

i=l 

and using the above arguments we also have 



< Cme 2 . 



Consequently, 

?:=i 

< ^-G^^^^Y^ ^ ] + Ce + Cme\ 

^ | 2g*,a:;a s (u),v j 2y t,:c;" eo j _ 2gi,x;« e ° j 2-^t,a:;ii eo ,v e ° j | 

+ 2 G^°^ [ 2 y^« £ °^°] + Ce + CmeJ 

_ | 2gf*,a:;ae (•"),!> J 2yt,a;;M eo ,-u eo j 2gi,i;n £ ° ,u e ° j 2yt,a:;ii eo ,« e ° j | 

+ J 2 (i, x; u e ° , v e °) + Ce + Cme| 

< J 2 (i, x; u eo , w eo ) + Ce + Cmef + Cr 3 , 
where we have used the fact that 

| 2 G t,x;a e (v),v^ 2yt,i;ii E »,u e °j _ 2 Qt,x;u e ° ,v e ° ^ 2y t,x\u c ° ,v e ° j | ^ 

Indeed, let us consider the following BSDE 

y s = 2 y M;«V + J* f 2 (r,X t r ^ a ^\y r ,z r ,a E (v r ),v r )dr + k t ,-k s -[ t z r dB r , 

k t =0, j (y r -h 2 (r,Xp x ' a ^))dk r = 0, 
which compared with 

Note that = u €a , on [[£,£"]], « = v e °, on [[t, 5"]], and from Lemma 2.3 we obtain 

| 2gt,i;o e W,» pyt,3;;ii eo ,D E0 j _ 2Qt,x;u s ° ,v e ° ^2yt,x;u sa ,v e ° j|2 

< CE[/* |/ 2 (r,X^^,y r ,z r , a e («) r , Vr )dr - / 2 (r, , j/ r , z r , , <«)| 2 | J" t ] 
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+CE[ sup \h 2 {r,X^ a ^ v ) ~ h^r^^ ^ )] 2 ]^ 

= CE[f* \h(r,Xl> x > a ^>\y r ,z r ,a £ {v) r ,v r )dr - h^X^" '^ ,y r ,z r ,uf,v So )\ 2 \T t } 
+CE[ sup \xp ai0 "^' v -X^" ^ ] 2 ]^ 

rG[S",f] 

< CE[ f 1 {V &p } \Ft] + Ct? < CE[t v - S v \F t ] + Ct? < Ct*, 
where we have used the boundcdness of f 2 , b and a . Consequently, 

m 
i=l 

<Ct^ +J 2 (t, x; u eo ,v £0 ) + Cs + Cme\ , 
from where, (5.13) and (5.14) we see that 

J 2 (t,x;a £ (v),v) < J 2 (t,x;u e °,v e °) + Ce + Cme\ + Csi + Cri. 

i i 

We can choose r > 0, e > 0, and E\ > such that Ce + Cmsft + Ce\ + Ct* < e and e < e. Thus, 

J 2 (t,x;a e (v),v) < J 2 (t 7 x;u £o ,v £ °) + s,v £ V t ,T- 

Using a symmetric argument we can construct j3 e £ Bt^T such that, for all u £ Ut^T, 

Ji(t,x;u,f3 e (u)) < Ji(i,x;w eo ,u eo ) + e, /3 £ (u e ° ) = V e ° . (5.15) 

Finally, from (5.10), (5.15), (5.7) and Lemma 5.2 it follows that (a e ,j3 e ) satisfies Definition 5.1. Hence, 
(ei, e 2 ) is a Nash equilibrium payoff. □ 

Proof of Theorem 5.5: Necessity of (5.4) and (5.5). 

Proof. Let us suppose that (ei,e 2 ) £ R 2 is a Nash equilibrium payoff at the point (t,x). Then, for any 
sufficiently small e > 0, there exists (a e ,(3 e ) £ At,T x &t,T such that, for all (a, (3) £ At,T X Bt,T 

Ji(t, x; a s ,P s ) > Ji(t, x; a, (3 e ) - e 4 , J 2 (t, x; a e ,(3 e ) > J 2 (t, x\ a e ,fi) - e 4 ,P - a.s., (5.16) 

and 

\E[J j {t,x;a e ^ e )]-e j \<£ A t j = 1,2. (5.17) 
It follows from Lemma 3.5 that there exists a unique couple (u £ ,v £ ) such that 

a e (v £ ) = u £ ,(3 e (u £ ) = v £ . 

We give the proof by contradiction. Note that (5.17) means that (5.5) holds. Assuming that (5.4) doesn't 
hold true, for all e' > 0, there exists some e £ (0, e') (for which we use the notations introduced above) 
and S £ [0, T — t] such that, for some j £ {1, 2}, say for j = 1, 

P(P( l Y%f' v ' < W^Xl^f^) -e | ft) > e) > 0. (5.18) 

We apply Lemma 5.3 to u £ and t + 5, it follows that, there exists an NAD strategy a £ At,T, such that, 
for all v £ Vt,T, 

a(v) — u £ , on [t, t + 5], 
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It follows from Lemma 3.5 that there exists a unique couple (u, v) £ Ut,T x Vt r such that 

S(u) = tt, /8 c (w) = v. 

Let us 

A = | < + 5) x t 4 ff> E ) - e } e Ji+a, (5.20) 

and define 

w e , on ([t,t + S) x fi) U ([t + (5,T] x A c ), 
on [i + 6, T] x A. 

Thanks to the nonanticipativity of j3 e E £>t,T we see that /3 £ (u) = (3 £ (u £ ) = v e on [t,t + 6], and for all 
s g [t + <f,T], 




f} e {u) = v t on A, 
f3 e (u £ ) = v £ , onA°. 
From standard arguments for SDEs and BSDEs it follows that 



x t,x;S(v),v^ on [f + 5, T] x A, 
x t,x-,u",v € ^ on[t + 8,T]x A c , 



as well as 



l v t,i;S,A(5) _ I *t+8 i 0nyi > 



IV' 



'y^"''" 5 , onA c 



Consequently, 



l n t,x;u,l3 e (u) ,l v t,x;u,j3 e (u)-. \ v t,x;u,fi e (u) -, 1 

l / ~ ( t,:B;5,;8 e (5)rlvt,a;j5Cu),i> 1 i lv*v";u" ,■«*■, i 

By Lemma 2.4 and (5.19) we deduce that 

> l G t ^f^[{W 1 {t + 5,X^f^)- E -)l A + X + T'- V ^aA 



Therefore, from (5.20) 



- U t,t+S l\ r t+S +£)1A+ Y t+S i-A" - ^A\ 

- U t,t+5 I Y t+S + nM 
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1 fit,x;u £ ,v £ \l\rt ,x;u £ .v £ . ^ 1 i 
Gr i,t+<5 ' I Y t+8 + 9 i ^J- 



(5.21) 



Let us consider the following BSDE: 



t+8 



/As 



y s >fti(a^ I; " v ), 8€[i,t + i], 

fct = 0, / (y s -h l (s,X t s > x ^' ve ))dk r =0, 



t+8 



2sy dill^ y ■ 



as well as 



t+5 

lyt,l;u e ,l) e _ lyt,i;u e ,u e _|_ / /l(r ^"*^' t ' e ^ E lyt,x;tl e , 



L t+<5 



t+<5 



1 Zt' X ' U ' V <lB r 



, 1 Ts-t,x;u e ,v € 1 |(-t,i;ii' ii" 

lyj.xiu'.ti' > hi(s,Xl' m ' uS ' ve ), S £ [t,t + S], 



Let us set 



y s = y a - 'vl !ul r 



, k s = k s - l Kt^ u ,z s =z s - l Zi> x > u , se[t,t + 5]. 



Then from Lemma 2.4 it follows that k s > 0, and we have 



t+s 



[h(r,X^ ,y r ,z r ,u s r ,v s r ) - h{r,X^ •« , .« , ,u=,t£)]dr 



2/ s = 

J S 

- e f t+s 

+k t+s - k s + -1 A - J z r dB r , se[t,t + S]. (5.22) 
For r£ [t, t + 5} , we set 

a r = l {Vrm (y r )- x (/i(r, J^«V 6 , j, rj z r , <, <) - h{r, , ^'^^ , z n <, <)) , 



6 r = 1 



-/l(r,^' : 



t.X'.U ,V £ l\ft,X\U E .V £ 1 ryt,X\U £ .V £ n E £ 



Z r 



Then, |a r | < L, |6 r | < L,r € [t,i + 5], and BSDE (5.22) has the following form: 



t+s 



y s = 2 1a+ I [a r y r + b r z r ]dr - j z r dB r + k t+ s - k s , se[t,t + 5]. 



t+8 



Put 



Q s = exp j a r dr + J b r dB r - i J \b r \ 2 drj , s £ [t, t + S] . 
It follows from Ito's formula to y s Q s that 



![1aQ 



t+s 



t+8 



Q r dk r \F t ] > -E[l A Q t+s \F t ]. 



Thanks to the Holder inequality we obtain 

P(A\F t ) 2 = (E[l A \F t }) 2 < E[l A Q t+s \Ft}E[Qi+8 \?t\. 
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We note that 



t+S r t+S ^ r t+S 



7 \Qtls \H = E[exp(- / a r dr- b r dB r + - / \b r \ 2 dr) \ F t ] 



pt+5 i rt+S 

< exp(LS + L 2 <S)E[exp ( - / b r dB r - - \b r \ 2 drj \ T t \ 
= exp(i(5 + L 2 <5). 

{n %ff' vS < W^Xgf'*) -e\T t )>s}( = {P(A\T t ) > e}). 



Let 



Then, 



A = 



y t > £ -E[l A Q t+s \F t ] 

> cM - LS - m)£ mAH) 2 = cxp( ~ M 2 ~ m)£ (nA\T t) f 

> yC l A , (5.23) 
for Co = cxp(— LS — L 2 6), where we use (5.18) in the last inequality. Combining (5.23) with 

— l v t,x:u e ,v c 1 s-yt,x;u c ,v e \\ v t,x;u e ,v E . £ , i 1 ,x;u" .v e \l v t,x\u e ,v e l 

Vt = yt- Y t ~ W,t+«5 i Y t+S + 2 A ' G t,t+8 I Y t+S ' J> 



we have 

3 



t !t+s [ Y t+s +2 L M> ^t,t+s I Y t+s J + y<-o1a, 
and (5.21) then yields 

e 3 

Ji(t,x;u,/3 e (u)) > Ji(t,x;a £ ,/3 £ ) + —C 1 A - 

Let us choose e' sufficiently small such that > e 4 . Since P(A) > 0, the above inequality contradicts 

with (5.16) for a(-) = u. The proof is complete. □ 

Before giving the existence theorem of a Nash equilibrium payoff we first establish the following 
proposition, which is crucial for the proof of the existence theorem of a Nash equilibrium payoff. 

Proposition 5.6. Under the assumptions of Theorem 5.5, for all e > 0, there exists (u e , v e ) £ l4t,T x Vt,T 
independent of Ft such that, for all t < s\ < s-2 < T , j = 1, 2 . 



> 1 



Let us first give some preliminary result. Since the proof of the following lemma is similar to that in 
[8], we omit here. 

Lemma 5.7. For all e > 0, all 6 £ [0,T — t] and x £ R" ; there exists (u £ ,v e ) £ Ut,T x Vt,T independent 
of Tt, such that, j = 1,2, 

W 3 (t,x)-e< iGl^iW^t + ^Xtff P-a.s. 

Let us establish the following Lemma. 

Lemma 5.8. Let n > 1 and let us fix some partition t = to < tx < • • • < t n = T of the interval [t,T\. 
Then, for all e > 0, there exists (u e , v £ ) £ U t _T x Vt,T independent of T t , such that, for all i = 0, • • • , n — 1, 

W . {%X l^^ ) _ £ < iGlXfWiU^X^f^)}, F-a.s. 
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Proof. Let us prove this lemma by induction. By the above lemma, it is obvious for i = 0. We now 
suppose that (it e ,i> e ) independent of J-j, is constructed on the interval [t, U) and we shall define it on 
[tj,£j_l_i). From the above lemma it follows that, for all y S K n , there exists (u v ,v v ) € Ut t ,T x Vu,T 
independent of J- t , such that, 



W 3 (t u y)- c -< WiU+iXt™ ,V )}, V-a.s,j = 1,2. 

For arbitrarily j = 1, 2, for all y, z S 1™ and s £ [t^ , , we set 



(5.24) 



1/2 = •'G^ y ^[W 3 (t l+1 ,X t 



ti,y;u y ,v l 



)}, and y 2 = X%*f>*')] 



Then let us consider the following BSDEs: 



+ l K t+5 - l K s 



j \ 



0. 



'• .'/ ~ //,(>..Vi '' : " •• ;;-/ ; A', i). 



and 



i+l 

„v „y \ 



ti+i 



y 2 s >h 3 (s,xy^'- y ), S G[u,t i+1 }, 



l K ti = 0, 



{y 2 s -h 3 {s,Xl^ y ^))d 2 K r = 0, 



From the Lemmas 2.3 and 3.1 it follows that 



rti,z;u y ,v \-\ |2 



< cnw 3 {t i+ ux^ u v ) - w 3 (t i+1 ,xl 



U+i 



+CE[\ / fjfaXZW^^z^vfidr- / fj(r,Xy< u ' v ^z^u^dr 



+CE[ sup \h 3 {s 1 X t ;^ uV ' vV )^h 3 {s 1 X 

ti<S<t i+1 



t i ,z;u v ,v y \\2 



< CE[\X, 



ti,y;u y ,v v v ti, z;u y , v y |2 
— A,. . . 



F t ] + CE[ / \X t r i '^ uV ' vy - X 



ti,z:u y ,v y |2 



dr 



+ce[ sup \x t s *<y- uV > vV _x t s i < z '' uV < vV \ 2 r u ]i 

ti<s<t i + i 

< C\y-z\. 

Combining the above inequality, Proposition 3.9 and (5.24) we see that 



W 3 {ti,z)-E < W j (t i ,y)-e + C\y-z\ i - 



{WAti + uXlf'f^)]- £ - + C\y-z\h 



< j G\':;Cf[W 3 {ti + i,X^f^)] ~ £ - + C\y- z\- 
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for C\y -z\* < |. 



s 

Let {Oj}i>i C £>(R") be a partition of E" with diam{O l ) < — and let yz G O;. Then, for z e Oi, 



Let us put 



Then 



W j (t i ,z)-e< 'OXC* mU+uXtZ?-'' *")], F-a.s. (5.25) 
u £ = lo l {X t > x ' ue ' ve )u w , v £ = l ,(X i ' x,u '' v ')v vl . 



i>i i>i 



jsyt,x;u ,v fjir t+ v t,x;u ,v \n 



\U £ ,V E r x — "S , ti ,X+ ,X ' U ,V \U B ,V £ . , * ~.„e „e o 



Z>1 

;>1 

= E G ^ ' [^(^-1.^+1 )]io,(^ x ), 

which together with (5.25) yields 

^^ e [w,(t i+1 ,z^f^)] 

> E^(*<> ) ' ^ iU '""*) 

i>i 

from which we get the desired result. □ 
Let us come to the proof of Proposition 5.6. 

Proof. Let t = to < t\ < ■ • ■ < t n = T be a partition of [f,T], and r = sup(ti + i — ti). By Proposition 3.9 

i 

and Lemma 5.4 we see that, for all j = 1, 2, < k < n, s £ [ifc, tfc+i) and (u, u) € x Vt,T) 

< 2E[|T^,X*~) - ^( S ,X t 4 ™)| 2 ] 

+2E[\w 3 ( Sl x t t f^ v ) - w^xt^ni 2 ) 

< C\s - t k \{l + E[|X*«| 2 ]) + CE[\X*f ^ - Xt^f] 

< Ct. (5.26) 

Here and after C represents a generic constant which may be different at different places. 

We let Lemma 5.8 we let (u £ ,v £ ) £ Ut.T x Vt,T be defined as in Lemma 5.8 for e = so, where £o > 
will be specified later. Then, for all i, < i < n, 

W^X^'^-eoK ^^XflWAU+uX^f'^)}, P-a.8. 
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For t < si < s 2 < T, let us suppose, without loss of generality, that t^i < Si < and t k < s 2 < ifc+ii 
for some l<i<fc<n— 1. Therefore, applying the Lemmas 2.3 and 2.4 we deduce that 



from which we see that 



> 3 G 



JG u,tn.i Wj{t k +i,x tk+1 )j 



t.x:u £ ,v e 



[W 3 (t kl Xlf^ )]-Ce 



■■■> j G 



t,x:u £ ,v £ 



[WjiU+uXlf^ ' v )]-C(k-i)e 















> 


j s^t,x\u £ 
G Sl,ti 


ve [w j (t i ,x t t f' uC ' ve ) 


> 


7 /-it,x:u E 
G Sl,ti 


v °[W j (t i ,X t t f' ue ' ve ) 


> 


J f^t^X\U £ 


v \w (t u xtf^^) 



)-C(fc-i + l)e ] 
)] - C(fc - i + 2)e 

2' 



where we put £o 



2Cn 



. We set 



h = 'Gl^^[W J ( S2 ,Xtf^^)]-W J ( Su Xlf' uC ^)+ £ -. 

In what follows we shall prove the following: 

E[\h-I 2 \ 2 } < Ct. 

Let us put 



7 /-iz.xy 
Vs = (■-.> 

Then we consider the associated BSDEs: 



\\:,{i,.x )}, S £[ Sl ,u]. 



y s = W j {t i ,Xl 

V.>hj(8,X*>* 



s e [si,ti], 



2 K t 



0, 



(j/r - hj{r,X; 



t,x;u ,v 



))dk r = 0, 



and 



Then applying Lemma 2.3 we conclude 



'), s G [Si,*i]. 



-CE[ sup |^( S) Z*^" S ' we ) - ^( Sl ,X*^ E ^)| 2 dr F ai ]i 

s 1 <s<t i 



• 3 

^t,:r;u E .u e \|2| 



^/T" 1 fillip y 



(5.27) 
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+C(ti - si) + CE[ sup \xl' x ' uS ' ve - X f s f ' uS > v£ | 2 

Si <S<ti 



where we have used assumptions (H3.3) and (H3.4) and the boundedness of fj. Since w e ) £ Ut,T x Vj,t 
is independent of J 7 * we have 

n'G^^w^xlf^^)] - Wi(a u X%*»'>*')\*\rt] 



-CE[ sup \X 

si<s<ti 



t,x;u ,v 



X 



t,x;u e ,v e |2 



By virtue of (5.26) wc have 

^^^W^X^^^-W^X^^^^Ct^. 
By a similar argument 

E[| J *G^£f [^(tfc+i,^' 1 ^)] - ^( fla ,Xif^)| 2 ] < Cr^ 
For s£ [si, s 2 ] we put 



and 



„,2 j s~it,x;u E .v £ ( n \rt,x:u £ ,v £ \i 



Let us consider the associated BSDEs: 



VI = JG s2,t k + 1 [Wj{tk+i,X t ' k ^ )]+/ fj{r,X r > • ,y r ,z r ,u r ,v r )dr 



J/J > ft J -(«,Jf*- s i«'' ') > SS [51,52], 

0, ['\y r -h j (r,X}>*->«'^))dl$ = 0, 



and 



z r dB r , 



y 2 s >h 3 {s,Xl 



o. 



! (y r -^-(r,X^^))dfc 2 =0, 



From the Lemmas 2.3 and 3.1 it follows that 

l J 'G^if/[^(t fc+ i,X^^)] - J G^^( S2 ,^f^)]| 2 
< CEIPG^f [^(t fe+ i,X^^)] - ^( S2 ,Z*f «> £ )| 2 |j- si ]. 

Hence, by (5.29) we see that 

n\ J GZ£fiWM +1 ,Xi£f> ve )] - j Gl^^[W j (s 2 ,X t s f^^)}\ 2 ] < Crh. 



(5.28) 
(5.29) 
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The above inequality and (5.28) yield 



\h-h\ 2 ] < Or?. 



Therefore, 



e, n e. 4E[|/i-/ 2 | 2 l iCr* 

nh < ~) < n\h - h\ > < y \ 2 < ^ £ > 



/ e 3 \ 2 

where we choose r < ( — — ) , and by (5.27) we have 



V4C7 



> 1 



We also refer to the fact that since (u £ ,v £ ) is independent of Tt, the conditional probability P(-|.Ft) of the 
event |w^(si,X*f ; " e > v *)-e < j G t s f^' v '[W j (s 2 ,X t s ' 2 x coincides with its probability. Indeed, also 

^Wj{suXlf ue ^)-e< j Glf^' ve [W j {s 2 ,X t s f ue ' vS )]\ is independent of T t The proof is complete. □ 
Finally, we give another main result: the existence theorem of a Nash equilibrium payoff. 

Theorem 5.9. Under the Isaacs condition (4-10), for all (t,x) £ [0, T] x K™, there exists a Nash equi- 
librium payoff at (t, x). 

Proof. By Theorem 5.5 we only have to prove that, for all e > 0, there exists (u £ ,v £ ) £ Ut,T x Vt,T 
which satisfies (5.4) and (5.5) for s £ [t,T],j = 1,2. For e > 0, let us consider (u £ ,v £ ) £ Ut,T x Vt,r 
given by Proposition 5.6, i.e., in particular, (u £ ,v £ ) is independent of Tt- Setting s\ = t and s 2 = 
T in Proposition 5.6, we get (5.4). Since (u £ ,v £ ) is independent of T tl Jj(t,x;u £ ,v e ),j = 1,2, are 

deterministic and |(Ji(£, x; u £ , v £ ), J 2 {t, x; u £ , v £ )), e > oj is a bounded sequence. Therefore, we can 

choose an accumulation point of this sequence, as £ -> 0. We denote this point by (ei,e 2 ). From 
Theorem 5.5 we see that (e\,e 2 ) is a Nash equilibrium payoff at (t, x). The proof is complete. □ 
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